systems that are too large to be simu- 
lated with a discrete element approach, 
PowderSim incorporates a continuum- 
based SPH module, which when consid- 
ering the addition of a calibrated, cohe- 
sive, constitutive model (Lunar Regolith 
Constitutive Model (LRCM) ) , is a novel 
use of mesh-free methods. Because of 
the discrete and continuum methods 
implemented in the same framework, 
the software can capture dynamic partic- 
ulate material behavior at a variety of 


spatial scales from the coarse-grain scale 
(DEM) to the bulk scale (SPH). The 
DEM capability also supports clustering, 
which allows it to capture a rich variety 
of shape detail. Advanced contact mod- 
els and charge spots capture many ef- 
fects of contact plasticity and hysteresis, 
roughness, adhesion, and electrostatic 
interaction of particles. The SPH capa- 
bility for bulk material behavior uses the 
LRCM to capture the critical-state behav- 
ior of cohesive lunar regolith. 


This work was done by Scott Johnson, Otis 
Walton, and Randolph Settgast of Grain- 
flow Dynamics for Glenn Research Center. 
Further information is contained in a TSP 
(see page 1). 

Inquiries concerning rights for the commer- 
cial use of this invention should be addressed 
to NASA Glenn Research Center, Innovative 
Partnerships Office, Attn: Steven Fedor, Mail 
Stop 4-8, 21000 Brookpark Road, Cleve- 
land, Ohio 44135. Refer to LEW-18801-1. 


© Multiple-Frame Detection of Subpixel Targets in Thermal 
Image Sequences 

This technique has applicability in fire detection, and tracking ships, ground vehicles, and aircraft. 

NASA’s Jet Propulsion Laboratory, Pasadena, California 


The new technology in this approach 
combines the subpixel detection infor- 
mation from multiple frames of a se- 
quence to achieve a more sensitive de- 
tection result, using only the 
information found in the images them- 
selves. It is taken as a constraint that the 
method is automated, robust, and com- 
putationally feasible for field networks 
with constrained computation and data 
rates. This precludes simply download- 
ing a video stream for pixel-wise co-regis- 
tration on the ground. It is also impor- 
tant that this method not require precise 
knowledge of sensor position or direc- 
tion, because such information is often 
not available. It is also assumed that the 
scene in question is approximately pla- 
nar, which is appropriate for a high-alti- 
tude airborne or orbital view. 

This approach tracks scene content to 
estimate camera motion and finds geo- 
metric relationships between the im- 
ages. An initial stage identifies stable 
image features, or interest points, in 


consecutive frames, and uses geometric 
relationships to estimate a “homogra- 
phy” — a transformation mapping be- 
tween frames. Interest points generally 
correspond to regions of high informa- 
tion or contrast. Previous work provides 
a wide range of interest point detectors. 
In this innovation, SIFT (Scale Invariant 
Feature Transform) keypoints recovered 
by a difference of Gaussians (DoG) op- 
erator applied at multiple scales are 
used. A nearest-neighbor matching pro- 
cedure identifies candidate matches be- 
tween frames. The end result of this first 
step is a list of candidate interest points 
and descriptors in each frame. 

An important benefit of SIFT detec- 
tion is that the system permits absolute 
georeferencing based on image contents 
alone. The SIFT features alone provide 
sufficient information to geolocate a hot 
pixel. This suggests an initial characteri- 
zation phase where the remote observer 
transmits high-contrast, SIFT descriptors 
along with images of the (fire-free) sur- 


face. The ground system, with possible 
human assistance, would determine the 
SIFT features’ geographic locations. 

During regular operations, the system 
can query the database to find geo- 
graphic locations of new observations. 
Any preferred single- or multiple-chan- 
nel detection rule is applied independ- 
ently in each frame with a very lenient 
threshold. Then, the algorithm matches 
consecutive detections across potentially 
large displacements, and associates 
them into tracks, i.e., unique physical 
events with a precise geographic loca- 
tion, that may appear in multiple 
frames. Finally, the system considers the 
entire sequence history of each track to 
make the final detection decision. 

This work was done by David R. Thomp- 
son of Caltech and Robert Kremens of 
Rochester Institute of Technology for NASA’s 
Jet Propulsion Laboratory. Further informa- 
tion is contained in a TSP ( see page 1). 
NPO-48129 


© Metric Learning to Enhance Hyperspectral Image Segmentation 

NASA’s Jet Propulsion Laboratory, Pasadena, California 


Unsupervised hyperspectral image 
segmentation can reveal spatial trends 
that show the physical structure of the 
scene to an analyst. They highlight bor- 
ders and reveal areas of homogeneity 
and change. Segmentations are inde- 
pendently helpful for object recogni- 
tion, and assist with automated produc- 
tion of symbolic maps. Additionally, a 
good segmentation can dramatically re- 


duce the number of effective spectra in 
an image, enabling analyses that would 
otherwise be computationally prohibi- 
tive. Specifically, using an over-segmen- 
tation of the image instead of individ- 
ual pixels can reduce noise and 
potentially improve the results of statis- 
tical post-analysis. 

In this innovation, a metric learning 
approach is presented to improve the 


performance of unsupervised hyper- 
spectral image segmentation. The pro- 
totype demonstrations attempt a su- 
perpixel segmentation in which the 
image is conservatively over-seg- 
mented; that is, the single surface fea- 
tures may be split into multiple seg- 
ments, but each individual segment, or 
superpixel, is ensured to have homog- 
enous mineralogy. 
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A segmentation strategy was tested 
based on the “Felzenszwalb” algorithm 
for its simplicity and computational ef- 
ficiency. This approach represents the 
hyperspectral image as an 8-connected 
grid of pixels that can begin as inde- 
pendent segments. Edges between 
nodes represent the distance between 
neighboring spectra, and each is 
weighted according to a measure of dis- 
tance between pixels. The algorithm it- 
eratively joins neighboring pixels to- 
gether into larger segments, and 
describes each segment by the mini- 
mum spanning tree of edges that joins 
all segments in the cluster. 


Hyperspectral segmentation algo- 
rithms partition images into spectrally 
homogenous regions. However, the 
exact definition of homogeneity is de- 
pendent on the chosen similarity metric. 
The segmentation algorithm is aug- 
mented with a task-specific distance met- 
ric. Here, a Mahalanobis distance metric 
is used, learned from training data. By 
leveraging a (small) set of labeled pixels 
with known mineralogical interpreta- 
tions, the metric suppresses uninforma- 
tive spectral content. Multiclass linear 
discriminant analysis (LDA) is used to 
maximize the ratio of between-class vs. 
within-class separation, defined by the 


Rayleigh quotient computed over la- 
beled training data. Other distance met- 
rics and segmentation strategies are pos- 
sible, and can be substituted for these 
choices in modular fashion as different 
applications demand. 

This work was done by David R. Thomp- 
son and Rebecca Castano of Caltech, Brian 
Bue of Rice University, and Martha S. 
Gilmore of Wesleyan University for NASA’s Jet 
Propulsion Laboratory. For more information, 
contact iaoffice@jpl.nasa.gov. 

This software is available for commercial li- 
censing. Please contact Daniel Broderick of 
the California Institute of Technology at 
danielb@caltech.edu. Refer to NPO-48092. 


© Basic Operational Robotics Instructional System 

Lyndon B. Johnson Space Center, Houston, Texas 


The Basic Operational Robotics In- 
structional System (BORIS) is a six-de- 
gree-of-freedom rotational robotic ma- 
nipulator system simulation used for 
training of fundamental robotics con- 
cepts, with in-line shoulder, offset 
elbow, and offset wrist. BORIS is used to 
provide generic robotics training to 
aerospace professionals including flight 
crews, flight controllers, and robotics 
instructors. It uses forward kinematic 
and inverse kinematic algorithms to 
simulate joint and end-effector motion, 


combined with a multibody dynamics 
model, moving-object contact model, 
and X-Windows based graphical user in- 
terfaces, coordinated in the Trick Simu- 
lation modeling environment. 

The motivation for development of 
BORIS was the need for a generic system 
for basic robotics training. Before 
BORIS, introductory robotics training 
was done with either the SRMS (Shuttle 
Remote Manipulator System) or SSRMS 
(Space Station Remote Manipulator Sys- 
tem) simulations. The unique construc- 


tion of each of these systems required 
some specialized training that distracted 
students from the ideas and goals of the 
basic robotics instruction. 

This work was done by Brian Keith Todd of 
Johnson Space Center, James Fischer of Titan 
Systems Corp., and Jane Falgout and John 
Schweers of L-3 Communications. For further 
information, contact the JSC Innovation Part- 
nerships Office at (281) 483-3809. MSC- 
24850-1 
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